Augmented reality systems and methods for sports racing

ABSTRACT

A computer-implemented method includes generating a live video signal of a scene associated with a field of view of a user, wherein the scene includes a first racing element associated with a race having a plurality of race rules. The method further includes determining, based on the live video signal in real time, a first racing value for the first racing element, based on a race rule of the plurality of race rules. The method further includes displaying an indication of the first racing value within the scene to the user in real time, so that the indication is associated with the first racing element within the scene.

FIELD

Embodiments described herein relate to augmented reality (AR) systemsand methods, and in particular to AR systems and methods for sportsracing.

BACKGROUND

Sport racing events, such as animal racing or auto racing, for example,have many aspects that make them attractive to spectators, both from anentertainment standpoint and a wagering and/or betting standpoint. Liveracing events may be viewed in person, e.g., in a sports venue such as aracetrack or stadium, or remotely, e.g., in a casino or otherenvironment, via a television or other video display. As technologyimproves and as the competition for the attention of bettors andspectators increases, there is a need for additional interactivefeatures that increase spectator involvement and excitement.

SUMMARY

According to an embodiment, a computer-implemented method includesgenerating a live video signal of a scene associated with a field ofview of a user, wherein the scene includes a first racing elementassociated with a race having a plurality of race rules. The methodfurther includes determining, based on the live video signal in realtime, a first racing value for the first racing element, based on a racerule of the plurality of race rules. The method further includesdisplaying an indication of the first racing value within the scene tothe user in real time, so that the indication is associated with thefirst racing element within the scene.

According to another embodiment, a system includes a memory and aprocessor coupled to the memory, the processor operable to perform amethod. The method includes generating a live video signal of a sceneassociated with a field of view of a user, wherein the scene comprises afirst racing element associated with a race having a plurality of racerules. The method further includes determining, based on the live videosignal in real time, a first racing value for the first racing element,based on a race rule of the plurality of race rules. The method furtherincludes displaying an indication of the first racing value within thescene to the user in real time, so that the indication is associatedwith the first racing element within the scene.

According to another embodiment, a non-transitory computer-readablemedium includes machine-readable instructions operable to cause aprocessor to perform a method. The method includes generating a livevideo signal of a scene associated with a field of view of a user,wherein the scene includes a first racing element associated with a racehaving a plurality of race rules. The method further includesdetermining, based on the live video signal in real time, a first racingvalue for the first racing element, based on a race rule of theplurality of race rules. The method further includes displaying anindication of the first racing value within the scene to the user inreal time, so that the indication is associated with the first racingelement within the scene.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a schematic block diagram illustrating a network configurationfor a plurality of gaming devices according to some embodiments.

FIGS. 2A to 2D illustrate mixed reality viewers according to variousembodiments.

FIG. 3A is a map of a gaming area, such as a casino floor.

FIG. 3B is a 3D wireframe model of the gaming area of FIG. 3A.

FIG. 4 is a view illustrating a user viewing a horse race using an ARviewer to view additional information associated with the race,according to an embodiment;

FIG. 5 is a view illustrating the user viewing the horse race of FIG. 4at a later time during the race using an AR viewer to view updatedinformation associated with the race, according to an embodiment;

FIG. 6 is a view illustrating a user viewing a horse race using an ARviewer to view virtual racing elements within the scene, according to anembodiment;

FIG. 7 is a view illustrating the horse race and virtual racing elementsof FIGS. 5A and 5B from the point of view of a jockey controlling thehorse, according to an embodiment;

FIG. 8 is a flowchart diagram of a method of using an AR viewer to viewracing values associated with a race, according to an embodiment; and

FIG. 9 is a block diagram that illustrates various components of an ARviewer device according to some embodiments.

DETAILED DESCRIPTION

Embodiments described herein relate to augmented reality (AR) systemsand methods, and in particular to AR systems and methods for sportsracing. According to an embodiment, a computer-implemented methodincludes generating a live video signal of a scene associated with afield of view of a user, wherein the scene includes a first racingelement associated with a race having a plurality of race rules. Themethod further includes determining, based on the live video signal inreal time, a first racing value for the first racing element, based on arace rule of the plurality of race rules. The method further includesdisplaying an indication of the first racing value within the scene tothe user in real time, so that the indication is associated with thefirst racing element within the scene.

Before discussing aspects of the embodiments disclosed herein, referenceis made to FIG. 1, which illustrates a networked gaming system 10 thatincludes a plurality of displays 100 and AR viewers 200. The gamingsystem 10 may be located, for example, on the premises of a gamingestablishment, such as a casino. The displays 100, which are typicallysituated in a casino sports and racing book or elsewhere on a casinofloor, may be in communication with each other and/or at least onecentral controller 40 through a data network or remote communicationlink 50. The data communication network 50 may be a private datacommunication network that is operated, for example, by the gamingfacility that operates the displays 100. Communications over the datacommunication network 50 may be encrypted for security. The centralcontroller 40 may be any suitable server or computing device whichincludes at least one processor and at least one memory or storagedevice. Each display 100 may be a passive display, or may be a smartdisplay that includes a processor that transmits and receives events,messages, commands or any other suitable data or signal between thedisplays 100 and the central controller 40. The display processor isoperable to execute such communicated events, messages or commands inconjunction with the operation of the display 100. Moreover, theprocessor of the central controller 40 is configured to transmit andreceive events, messages, commands or any other suitable data or signalbetween the central controller 40 and each of the individual displays100. In some embodiments, one or more of the functions of the centralcontroller 40 may be performed by one or more display processors.Moreover, in some embodiments, one or more of the functions of one ormore display processors as disclosed herein may be performed by thecentral controller 40.

A wireless access point 160 provides wireless access to the datacommunication network 50. The wireless access point 160 may be connectedto the data communication network 50 as illustrated in FIG. 1, or may beconnected directly to the central controller 40 or another serverconnected to the data communication network 50.

A player tracking server 45 may also be connected through the datacommunication network 50. The player tracking server 45 may manage aplayer tracking account that tracks the player's gameplay and spendingand/or other player preferences and customizations, manages loyaltyawards for the player, manages funds deposited or advanced on behalf ofthe player, and other functions. Player information managed by theplayer tracking server 45 may be stored in a player information database47.

As further illustrated in FIG. 1, a mixed reality viewer 200, or ARviewer 200, is provided. The AR viewer 200 communicates with one or moreelements of the system 10 to render two-dimensional (2D) and/orthree-dimensional (3D) content to a user, e.g., a casino operationsworker, in a virtual space, while at the same time allowing the casinooperations worker to see objects in the real space around the user,e.g., on the casino floor. That is, the AR viewer 200 combines a virtualimage with real images perceived by the user, including images of realobjects. In this manner, the AR viewer 200 “mixes” real and virtualreality into a single viewing experience for the user. In someembodiments, the AR viewer 200 may be further configured to enable theuser to interact with both the real and virtual objects displayed to theplayer by the AR viewer 200. In some embodiments, the AR viewer 200 maybe replaced with a virtual reality (VR) viewer that combines a videosignal of a real event with virtual reality elements to generate asingle mixed reality viewing experience via a VR display.

The AR viewer 200 communicates with one or more elements of the system10 to coordinate the rendering of mixed reality images, and in someembodiments mixed reality 3D images, to the user. For example, in someembodiments, the AR viewer 200 may communicate directly with a display100 over a wireless interface 202, which may be a Wi-Fi link, aBluetooth link, an NFC link, etc. In other embodiments, the AR viewer200 may communicate with the data communication network 50 (and devicesconnected thereto, including displays) over a wireless interface 204with the wireless access point 160. The wireless interface 204 mayinclude a Wi-Fi link, a Bluetooth link, an NFC link, etc. In stillfurther embodiments, the AR viewer 200 may communicate simultaneouslywith both the display 100 over the wireless interface 202 and thewireless access point 160 over the wireless interface 204. In theseembodiments, the wireless interface 202 and the wireless interface 204may use different communication protocols and/or different communicationresources, such as different frequencies, time slots, spreading codes,etc. For example, in some embodiments, the wireless interface 202 may bea Bluetooth link, while the wireless interface 204 may be a Wi-Fi link.

The wireless interfaces 202, 204 allow the AR viewer 200 to coordinatethe generation and rendering of mixed reality images to the user via theAR viewer 200.

In some embodiments, the gaming system 10 includes a mixed realitycontroller, or AR controller 70. The AR controller 70 may be a computingsystem that communicates through the data communication network 50 withthe displays 100 and the AR viewers 200 to coordinate the generation andrendering of virtual images to one or more users using the AR viewers200. The AR controller 70 may be implemented within or separately fromthe central controller 40.

In some embodiments, the AR controller 70 may coordinate the generationand display of the virtual images of the same virtual object to morethan one user by more than one AR viewer 200. As described in moredetail below, this may enable multiple users to interact with the samevirtual object together in real time. This feature can be used toprovide a shared experience to multiple users at the same time.

The AR controller 70 may store a three-dimensional wireframe map of agaming area, such as a casino floor, and may provide thethree-dimensional wireframe map to the AR viewers 200. The wireframe mapmay store various information about displays and other games orlocations in the gaming area, such as the identity, type and location ofvarious types of displays, games, etc. The three-dimensional wireframemap may enable an AR viewer 200 to more quickly and accurately determineits position and/or orientation within the gaming area, and also mayenable the AR viewer 200 to assist the user in navigating the gamingarea while using the AR viewer 200.

In some embodiments, at least some processing of virtual images and/orobjects that are rendered by the AR viewers 200 may be performed by theAR controller 70, thereby offloading at least some processingrequirements from the AR viewers 200. The AR viewer may also be able tocommunicate with other aspects of the gaming system 10, such as theplayer tracking server 45, a back bet server 60, or other device throughthe network 50.

Referring to FIGS. 2A to 2D, the AR viewer 200 may be implemented in anumber of different ways. For example, referring to FIG. 2A. in someembodiments, an AR viewer 200A may be implemented as a 3D headsetincluding a pair of semitransparent lenses 212 on which images ofvirtual objects may be displayed. Different stereoscopic images may bedisplayed on the lenses 212 to create an appearance of depth, while thesemitransparent nature of the lenses 212 allow the user to see both thereal world as well as the 3D image rendered on the lenses 212. The ARviewer 200A may be implemented, for example, using a Hololens™ fromMicrosoft Corporation. The Microsoft Hololens includes a plurality ofcameras and other sensors 211 that the device uses to build a 3D modelof the space around the user. The device 200A can generate a 3D image todisplay to the user that takes into account the real-world objectsaround the user and allows the user to interact with the 3D object.

The device 200A may further include other sensors, such as a gyroscopicsensor, a GPS sensor, one or more accelerometers, and/or other sensorsthat allow the device 200A to determine its position and orientation inspace. In further embodiments, the device 200A may include one or morecameras that allow the device 200A to determine its position and/ororientation in space using visual simultaneous localization and mapping(VSLAM). The device 200A may further include one or more microphonesand/or speakers that allow the user to interact audially with thedevice.

Referring to FIG. 2B, an AR viewer 200B may be implemented as a pair ofglasses 200B including a transparent prismatic display 214 that displaysan image to a single eye of the user. An example of such a device is theGoogle Glass device. Such a device may be capable of displaying imagesto the user while allowing the user to see the world around the user,and as such can be used as a mixed reality viewer.

In other embodiments, referring to FIG. 2C, the AR viewer may beimplemented using a virtual retinal display device 200C. In contrast todevices that display an image within the field of view of the user, avirtual retinal display raster scans an image directly onto the retinaof the user. Like the device 200B, the virtual retinal display device200C combines the displayed image with surrounding light to allow theuser to see both the real world and the displayed image. However, alsolike the device 200B, the virtual retinal display device 200C may beincapable of displaying 3D images to the user.

In still further embodiments, an AR viewer 200D may be implemented usinga mobile wireless device, such as a mobile telephone, a tablet computingdevice, a personal digital assistant, or the like. The device 200D maybe a handheld device including a housing 205 on which a touchscreendisplay device 216 including a digitizer 252 is provided. An inputbutton 230 may be provided on the housing and may act as a power orcontrol button. A rear facing camera 227 may be provided in a front faceof the housing 205. The device 200D may further include a front facingcamera 228 on a rear face of the housing 205. The device 200D mayinclude one or more speakers 250 and a microphone 229. The device 200Dmay provide a mixed reality display by capturing a video signal usingthe front facing camera 228 and displaying the video signal on thedisplay device 216, and also displaying a rendered image of a virtualobject over the captured video signal. In this manner, the user may seeboth a mixed image of both a real object in front of the device 200D aswell as a virtual object superimposed over the real object to provide amixed reality viewing experience.

Referring now to FIG. 3A, an example map 110 of a gaming area 120 isillustrated in plan view. The gaming area 120 may, for example, be acasino floor. The map 110 shows the location of a plurality of displays100 within the gaming area 120. As will be appreciated, the locations ofthe displays 100 and other games and objects (not shown) within a gamingarea 120 are generally fixed, although a casino operator may relocatedisplays from time to time, within the gaming area 120. As noted above,in order to assist the operation of the AR viewers 200, the ARcontroller 70 may store a three-dimensional wireframe map of the gamingarea 120, and may provide the three-dimensional wireframe map to the ARviewers 200.

An example of a wireframe map 121 is shown in FIG. 3B. The wireframe mapis a three-dimensional model of the gaming area 120, such as a race andsports book, for example. As shown in FIG. 3B, the wireframe map 121includes wireframe models 101 corresponding to the displays 100 that arephysically in the gaming area 120. The wireframe models 101 may bepregenerated to correspond to various display form factors and sizes.The pregenerated models may then be placed into the wireframe map, forexample, by a designer or other personnel. The wireframe map 121 may beupdated whenever the physical location of displays in the gaming area120 is changed.

In some embodiments, the wireframe map 121 may be generatedautomatically using an AR viewer 200, such as a 3D headset, that isconfigured to perform a three-dimensional depth scan of its surroundingsand generate a three-dimensional model based on the scan results. Thus,for example, an operator using an AR viewer 200A (FIG. 2A) may perform awalkthrough of the gaming area 120 while the AR viewer 200A builds the3D map of the gaming area.

The three-dimensional wireframe map 121 may enable an AR viewer 200 tomore quickly and accurately determine its position and/or orientationwithin the gaming area. For example, an AR viewer 200 may determine itslocation within the gaming area 120 using one or moreposition/orientation sensors. The AR viewer 200 then builds athree-dimensional map of its surroundings using depth scanning, andcompares its sensed location relative to objects within the generatedthree-dimensional map with an expected location based on the location ofcorresponding objects within the wireframe map 121. The AR viewer 200may calibrate or refine its position/orientation determination bycomparing the sensed position of objects with the expected position ofobjects based on the wireframe map 121. Moreover, because the AR viewer200 has access to the wireframe map 121 of the entire gaming area 120,the AR viewer 200 can be aware of objects or destinations within thegaming area 120 that it has not itself scanned. Processing requirementson the AR viewer 200 may also be reduced because the wireframe map 121is already available to the AR viewer 200.

In some embodiments, the wireframe map 121 may store various informationabout displays or other games and locations in the gaming area, such asthe identity, type, orientation and location of various types ofdisplays, the locations of exits, bathrooms, courtesy desks, cashiers,ATMs, ticket redemption machines, etc. Such information may be used byan AR viewer 200 to help the user navigate the gaming area. For example,if a user desires to find a destination within the gaming area, the usermay ask the AR viewer 200 for directions using a built-in microphone andvoice recognition function in the AR viewer 200 or use other handgestures or eye/gaze controls tracked by the AR viewer 200 (instead ofor in addition to voice control). The AR viewer 200 may process therequest to identify the destination, and then may display a virtualobject, such as a virtual path on the ground, virtual arrow, virtualsign, etc., to help the user to find the destination. In someembodiments, for example, the AR viewer 200 may display a halo or glowaround the destination to highlight it for the user, or have virtual 3Dsounds coming from it so users could more easily find the desiredlocation.

According to some embodiments, a user of an AR viewer 200 may use the ARviewer to obtain information about players and/or displays on a casinogaming floor. The information may be displayed to the user on the ARviewer 200 in a number of different ways such as by displaying images onthe AR viewer 200 that appear to be three dimensional or two-dimensionalelements of the scene as viewed through the AR viewer 200. In general,the type and/or amount of data that is displayed to the user may dependon what type of user is using the AR viewer 200 and, correspondingly,what level of permissions or access the user has. For example, an ARviewer 200 may be operated in one of a number of modes, such as a playermode, an observer mode or an operator mode. In a player mode, the ARviewer 200 may be used to display information about particular displayson a casino floor. The information may be generic information about adisplay or may be customized information about the displays based on theidentity or preferences of the user of the AR viewer 200. In an observermode, the AR viewer 200 may be used to display information aboutparticular displays on a casino floor or information about players ofdisplays on the casino floor. In an operator mode, which is described ingreater detail below, the AR viewer 200 may be used to displayinformation about particular displays or other games on a casino flooror information about players of displays or other games on the casinofloor, but the information may be different or more extensive than theinformation displayed to an observer or player.

In this regard, FIG. 4 is a view illustrating a user viewing a horserace 400 using an AR viewer 200 to view additional informationassociated with the race 400, according to an embodiment. The AR viewer200 generates a live video signal of a scene 402 associated with a fieldof view of a user 404. The scene 402 includes a first racing element406, which is a horse 408 and a jockey 410 controlling the horse 408 inthis example. The AR viewer 200 determines racing values 412 based onthe rules of the race 400, and displays indications 414 of the racingvalues 412 within the scene 402 to the user 404 in real time, so thatthe indication 414 is associated with the first racing element 406within the scene 402. In some examples, the locations of differentracing elements may be determined using additional or alternativemethods, such as GPS location, external camera(s), etc.

In this example, the first racing element is a horse 408 and a jockey410 controlling the horse 408, but it should be understood that thefirst racing element may be other elements, including other participantsor types of participants, environmental elements, or other real-worldelements within the scene 402. In this example, the racing values 412may include a racing position 416 of the race participant, pre-race odds418 for the race participant, expected payout 420 for a wager 421 placedby the user 404, or other information. For example, the expected payout420 may be calculated by determining the value of a wager 421 placed bythe user 404 and comparing the value of the wager 421 to the pre-raceodds 418 (or other odds if the user 404 placed the wager at a differenttime, i.e., during the race, or with different win conditions).

As shown by FIG. 5, the racing values 412 and indications 414 can beupdated in real time as the race 400 progresses. For example, thecurrent odds 422 for the participant to win the race 400 may bedisplayed next to the pre-race odds 418. The current odds 422 may bedetermined by the AR viewer 200 in real time based on the live videosignal and the race rules, and the indication may be updated accordinglyin real time to reflect the current odds 422. It should be understoodthat these features may be used for other types of racing events. Forexample, instead of representing a horse and jockey, the racing element406 may represent an automobile, e.g., a racecar, and a driver drivingthe automobile, for example. Other types of races may include dog races,harness racing, and others.

In some embodiments, the AR viewer 200 may display virtual racingelements that are not part of the real-world scene, but that interactwith the real-world racing elements under the rules of the race. In thisregard, FIG. 6 is a view illustrating a user 604 viewing a horse race600 using an AR viewer 200 to view virtual racing elements 624 withinthe scene 602, according to an embodiment. The virtual racing elements624, which are virtual obstacles in this embodiment, are displayedwithin the scene 602 by the AR viewer 200 in real time so that thevirtual racing elements 624 appear to the user 604 to be physicalelements, e.g., real world elements, within the scene 602. In otherexamples, the virtual racing elements 624 may be virtual racers, such asa horse and jockey competing in a different race, either simultaneouslywith the race at a different location (e.g., live) or in a previous raceat the same location or a different location.

In the example, of FIG. 6, a position of the first racing element 606,e.g., a horse 608 and jockey 610, and a position of the virtual racingelement 624 within the scene 602 are determined by the AR viewer 200.Based on these determined positions, the AR viewer 200 determineswhether an interaction 626 is occurring or will occur between thereal-world first racing element 606 and the virtual racing element 624within the scene 602. Upon the AR viewer 200 determining that aninteraction 626 between the real-world first racing element 606 and thevirtual racing element 624 has occurred (or has not occurred), a racingvalue 614, e.g., a point or monetary reward or penalty, is thendetermined based on the interaction 626 (or lack of interaction). Inthis example, the interaction 626 is a virtual collision between thereal-world first racing element 606 and the virtual racing element 624.

In some embodiments, the participant, e.g., the driver or jockey, etc.,may be have the capability to perceive the virtual racing element aswell. In this regard, FIG. 7 is a view illustrating the horse race 600and virtual racing elements 624 of FIGS. 6A and 6B from the point ofview of the jockey 610 controlling the horse 608 (not shown), accordingto an embodiment. In this example, the jockey 610 is wearing his or herown AR viewer 201, which generates a live video signal of scene 702being viewed by the jockey 610 based on a field of view 704 of thejockey 610. The virtual racing element 624, e.g. obstacle to be avoided,is displayed to the jockey 610 in real time within the scene 702, sothat the virtual racing element 624 appears to be a physical, real-worldelement within the scene 702 corresponding to the same virtual physicalelement being viewed by the user 604 of FIGS. 6A and 6B.

These and other examples may be implemented through one or morecomputer-implemented methods. In this regard, FIG. 8 is a flowchartdiagram of a method 800 of using an AR viewer to view racing valuesassociated with a race, according to an embodiment. In this embodiment,the method 800 includes generating a live video signal of a sceneassociated with a field of view of a user, wherein the scene comprises afirst racing element associated with a race having a plurality of racerules (Block 802). The method 800 further includes determining, based onthe live video signal in real time, a first racing value for the firstracing element, based on a race rule of the plurality of race rules(Block 804). The method further includes displaying an indication of thefirst racing value within the scene to the user in real time, so thatthe indication is associated with the first racing element within thescene (Block 806).

Reference is now made to FIG. 9, which is a block diagram thatillustrates various components of an AR viewer device 210, which mayembody or include the AR viewer 200, discussed above, according to someembodiments. As shown in FIG. 9, the AR viewer device 210 may include aprocessor 222 that controls operations of the AR viewer device 210.Although illustrated as a single processor, multiple special purposeand/or general-purpose processors and/or processor cores may be providedin the AR viewer device 210. For example, the AR viewer device 210 mayinclude one or more of a video processor, a signal processor, a soundprocessor and/or a communication controller that performs one or morecontrol functions within the AR viewer device 210. The processor 222 maybe variously referred to as a “controller,” “microcontroller,”“microprocessor” or simply a “computer.” The processor 222 may furtherinclude one or more application-specific integrated circuits (ASICs).

Various components of the AR viewer device 210 are illustrated in FIG. 9as being connected to the processor 222. It will be appreciated that thecomponents may be connected to the processor 222 and/or each otherthrough one or more busses 224 including a system bus, a communicationbus and controller, such as a USB controller and USB bus, a networkinterface, or any other suitable type of connection.

The AR viewer device 210 further includes a memory device 226 thatstores one or more functional modules 231 for performing the operationsdescribed above. Alternatively, or in addition, some of the operationsdescribed above may be performed by other devices connected to thenetwork, such as the network 50 of the system 10 of FIG. 1, for example.The AR viewer device 210 may communicate with other devices connected tothe network to facilitate performance of some of these operations. Forexample, the AR viewer device 210 may communicate and coordinate withcertain displays to identify elements of a race being displayed by aparticular display.

The memory device 226 may store program code and instructions,executable by the processor 222, to control the AR viewer device 210.The memory device 226 may include random access memory (RAM), which caninclude non-volatile RAM (NVRAM), magnetic RAM (ARAM), ferroelectric RAM(FeRAM) and other forms as commonly understood in the gaming industry.In some embodiments, the memory device 226 may include read only memory(ROM). In some embodiments, the memory device 226 may include flashmemory and/or EEPROM (electrically erasable programmable read onlymemory). Any other suitable magnetic, optical and/or semiconductormemory may operate in conjunction with the gaming device disclosedherein.

The AR viewer device 210 may include a communication adapter 231 thatenables the AR viewer device 210 to communicate with remote devices,such as the wireless network, another AR viewer device 210, and/or awireless access point, over a wired and/or wireless communicationnetwork, such as a local area network (LAN), wide area network (WAN),cellular communication network, or other data communication network,e.g., the network 50 of FIG. 1.

The AR viewer device 210 may include one or more internal or externalcommunication ports that enable the processor 222 to communicate withand to operate with internal or external peripheral devices, such asdisplays 232, speakers 234, cameras 236, sensors, such as motion sensors238, input devices 240, such as buttons, switches, keyboards, pointerdevices, and/or keypads, mass storage devices, microphones 242, hapticfeedback devices 244 and wireless communication devices. In someembodiments, internal or external peripheral devices may communicatewith the processor through a universal serial bus (USB) hub (not shown)connected to the processor 222. Although illustrated as being integratedwith the AR viewer device 210, any of the components therein may beexternal to the AR viewer device 210 and may be communicatively coupledthereto. Although not illustrated, the AR viewer device 210 may furtherinclude a rechargeable and/or replaceable power device and/or powerconnection to a main power supply, such as a building power supply.

In some embodiments, the AR viewer device 210 may include a head mounteddevice (HMD) and may include optional wearable add-ons that include oneor more sensors and/or actuators. Including ones of those discussedherein. The AR viewer device 210 may be a head-mounted augmented-reality(AR) (also referred to as mixed-reality) device configured to provideelements of the SVE as part of a real-world scene being viewed by theuser wearing the AR viewer device 210.

In the above-description of various embodiments, various aspects may beillustrated and described herein in any of a number of patentableclasses or contexts including any new and useful process, machine,manufacture, or composition of matter, or any new and useful improvementthereof. Accordingly, various embodiments described herein may beimplemented entirely by hardware, entirely by software (includingfirmware, resident software, micro-code, etc.) or by combining softwareand hardware implementation that may all generally be referred to hereinas a “circuit,” “module,” “component,” or “system.” Furthermore, variousembodiments described herein may take the form of a computer programproduct comprising one or more computer readable media having computerreadable program code embodied thereon.

Any combination of one or more computer readable media may be used. Thecomputer readable media may be a computer readable signal medium or anon-transitory computer readable storage medium. A computer readablestorage medium may be, for example, but not limited to, an electronic,magnetic, optical, electromagnetic, or semiconductor system, apparatus,or device, or any suitable combination of the foregoing. More specificexamples (a non-exhaustive list) of the computer readable storage mediumwould include the following: a portable computer diskette, a hard disk,a random-access memory (RAM), a read-only memory (ROM), an erasableprogrammable read-only memory (EPROM or Flash memory), an appropriateoptical fiber with a repeater, a portable compact disc read-only memory(CD-ROM), an optical storage device, a magnetic storage device, or anysuitable combination of the foregoing. In the context of this document,a computer readable storage medium may be any tangible non-transitorymedium that can contain, or store a program for use by or in connectionwith an instruction execution system, apparatus, or device.

A computer readable signal medium may include a propagated data signalwith computer readable program code embodied therein, for example, inbaseband or as part of a carrier wave. Such a propagated signal may takeany of a variety of forms, including, but not limited to,electro-magnetic, optical, or any suitable combination thereof. Acomputer readable signal medium may be any computer readable medium thatis not a computer readable storage medium and that can communicate,propagate, or transport a program for use by or in connection with aninstruction execution system, apparatus, or device. Program codeembodied on a computer readable signal medium may be transmitted usingany appropriate medium, including but not limited to wireless, wireline,optical fiber cable, RF, etc., or any suitable combination of theforegoing.

Computer program code for carrying out operations for aspects of thepresent disclosure may be written in any combination of one or moreprogramming languages, including an object oriented programming languagesuch as Java, Scala, Smalltalk, Eiffel, JADE, Emerald, C++, C #, VB.NET,Python or the like, conventional procedural programming languages, suchas the “C” programming language, Visual Basic, Fortran 2003, Perl, COBOL2002, PHP, ABAP, dynamic programming languages such as Python, Ruby andGroovy, or other programming languages. The program code may executeentirely on the user's computer, partly on the user's computer, as astand-alone software package, partly on the user's computer and partlyon a remote computer or entirely on the remote computer or server. Inthe latter scenario, the remote computer may be connected to the user'scomputer through any type of network, including a local area network(LAN) or a wide area network (WAN), or the connection may be made to anexternal computer (for example, through the Internet using an InternetService Provider) or in a cloud computing environment or offered as aservice such as a Software as a Service (SaaS).

Various embodiments were described herein with reference to flowchartillustrations and/or block diagrams of methods, apparatus (systems),devices and computer program products according to various embodimentsdescribed herein. It will be understood that each block of the flowchartillustrations and/or block diagrams, and combinations of blocks in theflowchart illustrations and/or block diagrams, can be implemented bycomputer program instructions. These computer program instructions maybe provided to a processor of a general-purpose computer, specialpurpose computer, or other programmable data processing apparatus toproduce a machine, such that the instructions, which execute via theprocessor of the computer or other programmable instruction executionapparatus, create a mechanism for implementing the functions/actsspecified in the flowchart and/or block diagram block or blocks.

These computer program instructions may also be stored in anon-transitory computer readable medium that when executed can direct acomputer, other programmable data processing apparatus, or other devicesto function in a particular manner, such that the instructions whenstored in the computer readable medium produce an article of manufactureincluding instructions which when executed, cause a computer toimplement the function/act specified in the flowchart and/or blockdiagram block or blocks. The computer program instructions may also beloaded onto a computer, other programmable instruction executionapparatus, or other devices to cause a series of operational steps to beperformed on the computer, other programmable apparatuses or otherdevices to produce a computer implemented process such that theinstructions which execute on the computer or other programmableapparatus provide processes for implementing the functions/actsspecified in the flowchart and/or block diagram block or blocks.

The flowchart and block diagrams in the figures illustrate thearchitecture, functionality, and operation of possible implementationsof systems, methods, and computer program products according to variousaspects of the present disclosure. In this regard, each block in theflowchart or block diagrams may represent a module, segment, or portionof code, which comprises one or more executable instructions forimplementing the specified logical function(s). It should also be notedthat, in some alternative implementations, the functions noted in theblock may occur out of the order noted in the figures. For example, twoblocks shown in succession may, in fact, be executed substantiallyconcurrently, or the blocks may sometimes be executed in the reverseorder, depending upon the functionality involved. It will also be notedthat each block of the block diagrams and/or flowchart illustration, andcombinations of blocks in the block diagrams and/or flowchartillustration, can be implemented by special purpose hardware-basedsystems that perform the specified functions or acts, or combinations ofspecial purpose hardware and computer instructions.

The terminology used herein is for the purpose of describing particularaspects only and is not intended to be limiting of the disclosure. Asused herein, the singular forms “a”, “an” and “the” are intended toinclude the plural forms as well, unless the context clearly indicatesotherwise. It will be further understood that the terms “comprises”and/or “comprising,” when used in this specification, specify thepresence of stated features, steps, operations, elements, and/orcomponents, but do not preclude the presence or addition of one or moreother features, steps, operations, elements, components, and/or groupsthereof. As used herein, the term “and/or” includes any and allcombinations of one or more of the associated listed items and may bedesignated as “/” Like reference numbers signify like elementsthroughout the description of the figures.

Many different embodiments have been disclosed herein, in connectionwith the above description and the drawings. It will be understood thatit would be unduly repetitious and obfuscating to literally describe andillustrate every combination and subcombination of these embodiments.Accordingly, all embodiments can be combined in any way and/orcombination, and the present specification, including the drawings,shall be construed to constitute a complete written description of allcombinations and subcombinations of the embodiments described herein,and of the manner and process of making and using them, and shallsupport claims to any such combination or subcombination.

What is claimed is:
 1. A computer-implemented method comprising:generating a live video signal of a scene associated with a field ofview of a user, wherein the scene comprises a first racing elementassociated with a race having a plurality of race rules; determining,based on the live video signal in real time before a start time of therace, a first racing value for the first racing element, based on a racerule of the plurality of race rules, wherein determining the firstracing value for the first racing element comprises determining pre-raceodds associated with the first racing element in real time; displayingan indication of the pre-race odds within the scene in real time beforethe start time of the race at an augmented reality display device beingworn by the user, so that the indication is associated with the firstracing element within the scene; determining, based on the live videosignal in real time during the race after the start time of the race, asecond racing value for the first racing element, based on the race ruleof the plurality of race rules, wherein determining the second racingvalue for the first racing element comprises determining current oddsassociated with the first racing element in real time; and displaying,at the augmented reality display device, an indication of the currentodds within the scene in real time after the start time of the race, sothat the indication is associated with the first racing element withinthe scene.
 2. The method of claim 1, wherein the first racing element isa race participant, and wherein determining the second racing value forthe first racing element comprises determining a racing position of therace participant in real time during the race.
 3. The method of claim 2,wherein the race participant comprises a horse and a jockey controllingthe horse.
 4. The method of claim 2, wherein the race participantcomprises an automobile and a driver driving the automobile.
 5. Themethod of claim 1, further comprising: determining, based on the livevideo signal in real time after the start time of the race, updatedcurrent odds for the first racing element to win the race, based on thecurrent odds and the race rule of the plurality of race rules; andupdating, in real time, the indication of the current odds associatedwith the first racing element within the scene to indicate the updatedcurrent odds.
 6. The method of claim 1, further comprising determining awager value based on a wager placed by the user; and determining apayout value in real time based on the wager value and the first racingvalue associated with the first racing element.
 7. The method of claim1, further comprising: determining, based on the live video signal inreal time, a virtual racing element; and displaying the virtual racingelement within the scene to the user in real time, so that the virtualracing element appears to the user to be a physical element within thescene.
 8. The method of claim 7, wherein determining the second racingvalue for the first racing element comprises: determining a firstposition of the first racing element within the scene; determining asecond position of the virtual racing element within the scene;determining an interaction between the first racing element and thevirtual racing element within the scene during the race based on thefirst position of the first racing element and the second position ofthe virtual racing element within the scene; and determining the secondracing value based on the interaction between the first racing elementand the virtual racing element within the scene.
 9. The method of claim8, wherein determining an interaction between the first racing elementand the virtual racing element within the scene comprises determining acollision between the first racing element and the virtual racingelement.
 10. The method of claim 8, wherein the first racing element isa race participant, and wherein determining the first position of thefirst racing element within the scene comprises determining a positionof the race participant within the scene.
 11. The method of claim 10,wherein the scene associated with the field of view of the user is afirst scene, the method further comprising: generating a second livevideo signal of a second scene associated with a field of view of therace participant; and displaying, at a second display device, thevirtual racing element within the second scene to the race participantin real time, so that the virtual racing element appears to the raceparticipant to be a physical element within the second scenecorresponding to the physical element within the first scene.
 12. Asystem comprising: a memory; and a processor circuit coupled to thememory, the memory comprising machine-readable instructions that, whenexecuted by the processor circuit, cause the processor circuit to:generate a live video signal of a scene associated with a field of viewof a user, wherein the scene comprises a first racing element associatedwith a race having a plurality of race rules; determine, based on thelive video signal in real time before a start time of the race, a firstracing value for the first racing element, based on a race rule of theplurality of race rules, wherein determining the first racing value forthe first racing element comprises determining pre-race odds associatedwith the first racing element in real time; display, at an augmentedreality display device, an indication of the pre-race odds within thescene to the user in real time before the start time of the race, sothat the indication is associated with the first racing element withinthe scene; determine, based on the live video signal in real time afterthe start time of the race, a second racing value for the first racingelement, based on the race rule of the plurality of race rules, whereindetermining the second racing value for the first racing elementcomprises determining current odds associated with the first racingelement in real time; and display, at the augmented reality displaydevice, an indication of the current odds within the scene to the userin real time after the start time of the race, so that the indication isassociated with the first racing element within the scene.
 13. Thesystem of claim 12, wherein the instructions further cause the processorcircuit to: determine, based on the live video signal in real time, avirtual racing element; and display the virtual racing element withinthe scene to the user in real time, so that the virtual racing elementappears to the user to be a physical element within the scene.
 14. Thesystem of claim 12, wherein the instructions further cause the processorcircuit to: determine, based on the live video signal in real time afterthe start time of the race, updated current odds for the first racingelement to win the race, based on the current odds and the race rule ofthe plurality of race rules; and updating, in real time, the indicationof the current odds associated with the first racing element within thescene to indicate the updated current odds.
 15. The system of claim 12,wherein the first racing element is a race participant, and wherein theinstructions that cause the processor circuit to determine the secondracing value for the first racing element further cause the processorcircuit to determine a racing position of the race participant in realtime during the race.
 16. The system of claim 12, wherein theinstructions further cause the processor circuit to: determine, based onthe live video signal in real time, a virtual racing element; anddisplay the virtual racing element within the scene to the user in realtime, so that the virtual racing element appears to the user to be aphysical element within the scene.
 17. The system of claim 16, whereinthe instructions that cause the processor circuit to determine thesecond racing value for the first racing element further cause theprocessor circuit to: determine a first position of the first racingelement within the scene; determine a second position of the virtualracing element within the scene; determine an interaction between thefirst racing element and the virtual racing element within the sceneduring the race based on the first position of the first racing elementand the second position of the virtual racing element within the scene;and determine the second racing value based on the interaction betweenthe first racing element and the virtual racing element within thescene.
 18. A system comprising: a memory; and a processor circuitcoupled to the memory, the memory comprising machine-readableinstructions that cause the processor circuit to: generate a live videosignal of a first scene associated with a field of view of a spectatorof a race, wherein the first scene comprises a first racing elementassociated with the race; determine, based on the live video signal inreal time, a virtual racing element; display the virtual racing elementwithin the first scene in real time at a first augmented reality displaydevice associated with the spectator, so that the virtual racing elementappears to the spectator to be a physical element within the firstscene; generate a second live video signal of a second scene associatedwith a field of view of a participant in the race; and display thevirtual racing element within the second scene in real time at a secondaugmented reality display device associated with the participant, sothat the virtual racing element appears to the participant to be aphysical element within the second scene corresponding to the physicalelement within the first scene.
 19. The system of claim 18, wherein theinstructions that cause the processor circuit to display the virtualracing element within the first scene further cause the processorcircuit to: determine a first virtual position within the first scenewith respect to a position of the first racing element within the firstscene; and display the virtual racing element at the first virtualposition within the first scene; and wherein the instructions that causethe processor circuit to display the virtual racing element within thefirst scene further cause the processor circuit to: determine a secondvirtual position within the second scene with respect to a position ofthe first racing element within the second scene, wherein the firstvirtual position corresponds to the second virtual position; and displaythe virtual racing element at the second virtual position within thesecond scene.
 20. The system of claim 18, wherein the virtual racingelement comprises a virtual participant in the race.